409 research outputs found
GPU-enabled Function-as-a-Service for Machine Learning Inference
Function-as-a-Service (FaaS) is emerging as an important cloud computing
service model as it can improve the scalability and usability of a wide range
of applications, especially Machine-Learning (ML) inference tasks that require
scalable resources and complex software configurations. These inference tasks
heavily rely on GPUs to achieve high performance; however, support for GPUs is
currently lacking in the existing FaaS solutions. The unique event-triggered
and short-lived nature of functions poses new challenges to enabling GPUs on
FaaS, which must consider the overhead of transferring data (e.g., ML model
parameters and inputs/outputs) between GPU and host memory. This paper proposes
a novel GPU-enabled FaaS solution that enables ML inference functions to
efficiently utilize GPUs to accelerate their computations. First, it extends
existing FaaS frameworks such as OpenFaaS to support the scheduling and
execution of functions across GPUs in a FaaS cluster. Second, it provides
caching of ML models in GPU memory to improve the performance of model
inference functions and global management of GPU memories to improve cache
utilization. Third, it offers co-designed GPU function scheduling and cache
management to optimize the performance of ML inference functions. Specifically,
the paper proposes locality-aware scheduling, which maximizes the utilization
of both GPU memory for cache hits and GPU cores for parallel processing. A
thorough evaluation based on real-world traces and ML models shows that the
proposed GPU-enabled FaaS works well for ML inference tasks, and the proposed
locality-aware scheduler achieves a speedup of 48x compared to the default,
load balancing only schedulers
Two Cases of Lichen Planus Pigmentosus Presenting with a Linear Pattern
We report two cases of lichen planus pigmentosus (LPP) that developed in a unilateral linear pattern. The patients presented with unilateral linear brown macules on the extremities. Skin biopsy showed orthokeratosis, basal hydropic degeneration with scarce lymphohistiocytic infiltrates, and numerous melanophages in both patients. These patients, to the best of our knowledge, are the first cases of LPP presenting with a linear pattern. LPP should be considered in the differential diagnosis of linear hyperpigmented skin lesions
- …